Remember the Curse of Dimensionality: The Case of Goodness-of-Fit Testing in Arbitrary Dimension

نویسندگان

  • Ery Arias-Castro
  • Bruno Pelletier
  • Venkatesh Saligrama
چکیده

Despite a substantial literature on nonparametric two-sample goodness-of-fit testing in arbitrary dimensions, there is no mention there of any curse of dimensionality. In fact, in some publications, a parametric rate is derived. As we discuss below, this is because a directional alternative is considered. Indeed, even in dimension one, Ingster (1987) has shown that the minimax rate is not parametric. In this paper, we extend his results to arbitrary dimension and confirm that the minimax rate is not only nonparametric, but exhibits a prototypical curse of dimensionality. We further extend Ingster’s work to show that simple tests based on bincounting achieve the minimax rate. Moreover, these tests adapt to the intrinsic dimensionality of the data — when the underlying distributions are supported on a lower-dimensional surface.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

An Updated Review of Goodness of Fit Tests Based on Entropy

Different approaches to goodness of fit (GOF) testing are proposed. This survey intends to present the developments on Goodness of Fit based on entropy during the last 50 years, from the very first origins until the most recent advances for different data and models. Goodness of fit tests based on Shannon entropy was started by Vasicek in 1976 and were continued by many authors. In this paper, ...

متن کامل

ساخت و اعتباریابی مقیاس مهارتهای درون فردی و بین فردی زوجها

The purpose of the present study is to develop and evaluate psychometric properties of the Intrapersonal and Interpersonal Skills of Couples Scale (IISCS). In terms of testing, the research method was of descriptive type and the sampled statistical population included married men and women living in the city of Tehran, Iran. In this respect, 470 Iranian married men and women (277 women and 193 ...

متن کامل

Sub-pixel classification of hydrothermal alteration zones using a kernel-based method and hyperspectral data; A case study of Sarcheshmeh Porphyry Copper Mine and surrounding area, Kerman, Iran

Remote sensing image analysis can be carried out at the per-pixel (hard) and sub-pixel (soft) scales. The former refers to the purity of image pixels, while the latter refers to the mixed spectra resulting from all objects composing of the image pixels. The spectral unmixing methods have been developed to decompose mixed spectra. Data-driven unmixing algorithms utilize the reference data called...

متن کامل

Model checking for parametric single-index models: A dimension- reduction model-adaptive approach

Local smoothing testing based on multivariate nonparametric regression estimation is one of the main model checking methodologies in the literature. However, the relevant tests suffer from typical curse of dimensionality, resulting in slow convergence rates to their limits under the null hypothesis and less deviation from the null hypothesis under alternative hypotheses. This problem prevents t...

متن کامل

A Multi Linear Discriminant Analysis Method Using a Subtraction Criteria

Linear dimension reduction has been used in different application such as image processing and pattern recognition. All these data folds the original data to vectors and project them to an small dimensions. But in some applications such we may face with data that are not vectors such as image data. Folding the multidimensional data to vectors causes curse of dimensionality and mixed the differe...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2016